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DETAILED ACTION 

1 . This action is responsive to communications: Amendment, filed on 12/15/2005. 
This action is final. 

2. Claims 2-5, 7 and 9-10 are pending in this application. Claims 3 and 9 are 
independent claims. In the Amendment, filed on 12/15/2005, claims 2-5, 7 and 9-10 
were amended and claim 12 was canceled. 

3. The present title of the invention is "Method and system for presenting three- 
dimensional computer graphics images using multiple graphics processing units" as 
filed originally. 

Claim Rejections - 35 USC § 103 

4. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

5. Claims 2-5, 7 and 9-10 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Knittel et al. (6,532,017) and further in view of Kaufman et al. 
(5,760,781). 

6. As per claim 3, Knittel et al. (6,532,017), hereinafter Knittel, discloses a method 
for presenting three-dimensional computer graphics images of a scene using multiple 
graphics processing units, comprising the steps of: 

(1) allocating, to the multiple graphics processing units, a set of three- 
dimensional computer graphics data such that said allocated set of three-dimensional 
computer graphics data corresponds to portions of the scene that lie within rectangular 
subvolumes to which the multiple graphics processing units have been assigned (Figure 
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7 V-Bus to 210 "The VRC 202 includes a pipelined processing element 210 having 4 
parallel rendering pipelines 212 ... The processing element 210 obtains voxel data from 
the voxel memory 100 via voxel memory interface logic 216", column 14, line 61-63, 
where the rendering pipelines are the graphics processing units); 

(2) determining a viewing position, wherein said determined viewing position 
determines an aspect of said allocated set of three-dimensional computer graphics data 
to be rendered (Figure 1 where the view direction determines a viewing position); and 

(3) communicating said determined viewing position to the multiple graphics 
processing units ("All of the calculations for data positions having a given x coefficient 
modulo 4 are processed by the same rendering pipeline", column 15, line 11-16); 

(4) rendering, by the multiple graphics processing units, said allocated set of 
three-dimensional computer graphics data (where each pipeline can perform 
"interpolation, classification, gradient estimation, illumination, and compositing", 
Abstract); 

(5) combining said rendered set of three-dimensional computer graphics data 
with image combiners (Figure 4 29 "the colors, levels of brightness, and transparencies 
assigned to all of the samples along all of the rays are applied as illustrated at 29 to a 
compositing unit 124 that mathematically combines the sample values into pixels 
depicting the resulting image 32 for display on image plane 16", column 9, line 34-40, 
where the compositing unit is considered combiner), wherein outputs from the multiple 
graphics processing units are direct inputs to first stage image combiners and outputs 
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from at least two of the first stage image combiners are direct inputs to a second stage 
image combiner, thereby producing a three-dimensional computer graphics image; and 

(6) presenting, for viewing, said combined three-dimensional computer graphics 
image (Figure 4, item 32). 

Knittel discloses a method for presenting three-dimensional computer graphics 
images using multiple graphics processing units. It is noted that Knittel does not 
explicitly disclose "outputs from the multiple graphics processing units are direct inputs 
to first stage image combiners and outputs from at least two of the first stage image 
combiners are direct inputs to a second stage image combiner, thereby producing a 
three-dimensional computer graphics image", however, this is known in the art as taught 
by Kaufman et al., hereafter Kaufman. Kaufman discloses a method of volume 
visualization in which the voxel data is combined hierarchically (Figure 6 where voxel 
combination unit 38 is considered an image combiner and a voxel is considered a 
subvolume of a image). 

Thus, it would have been obvious to one of ordinary skill in the art to incorporate 
the teaching of Kaufman into Knittel because Knittel discloses a method of presenting 
three-dimensional computer graphics and Kaufman discloses the image is combined in 
several stages in order to quickly generate a three-dimensional image. 
8. As per claim 2, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Knittel further discloses loading, into memory cells 
accessible by the multiple graphics processing units, the set of three-dimensional 
computer graphics data corresponding to the portion portions of the scene that lies lie 
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within the rectangular subvolumes to which the multiple graphics processing unit units 
have been assigned (Figure 6 204 "section memory 204 is used to store sections of a 
volume during rendering of the volume data set by the VRC", column 14, line 47-48 and 
Fig. 10 depicts loading of the subvolume to memory). 

9. As per claim 4, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Kaufman further discloses wherein said combining further 
comprises the step of 

(5) ordering said rendered set of three-dimensional computer graphics data 
based on locations between said determined viewing position and the rectangular 
subvolumes to which the multiple graphics processing units have been assigned (Figure 
1, item 6; "The conveyer 10 performs a deskewing operation in order to match the 
physical sequential order of the input modules of the ray projection tree 6 to the 
sequential order of the voxels of each viewing ray", column 2, line 3-6). 

Thus, it would have been obvious to one of ordinary skill in the art to incorporate 
the teaching of Kaufman into Knittel because Knittel discloses a method of presenting 
three-dimensional computer graphics and Kaufman discloses the image is combined in 
in sequential order in order to generate a three-dimensional image related to a 
projection array. 

10. As per claim 5, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Knittel further discloses combining further comprises the 
step of: 
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(5) blending said rendered set of three-dimensional computer graphics data 
(Figure 4 29 "a compositing unit 124 that mathematically combines the sample values 
into pixels depicting the resulting image 32", column 9, line 36-39). 

11. As per claim 7, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 3, and Knittel further discloses wherein each of the image 
combiners has an associated frame buffer for storing said combined three-dimensional 
computer graphics image (Figure 14, item 200 where the pixel memory stores said 
combined three-dimensional computer graphics image). 

12. As per claim 9, Knittel discloses a system for presenting three-dimensional 
computer graphics images of a scene, comprising: 

memory for storing a set of three-dimensional computer graphics data (Figure 14, 
item 100); 

multiple graphics processing units for rendering the set of three-dimensional 
computer graphics data that corresponds to portions of the scene that lie within 
rectangular subvolumes to which said multiple graphics processing units are assigned 
(Figure 7 V-Bus to 210 "The VRC 202 includes a pipelined processing element 210 
having 4 parallel rendering pipelines 212 ... The processing element 210 obtains voxel 
data from the voxel memory 100 via voxel memory interface logic 216", column 14, line 
61-63, where the rendering pipelines are considered multiple graphics processing 
units); 

a bus for communicating a viewing position to each of said multiple graphics 
processing units, wherein the viewing position determines an aspect of the set of three- 
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dimensional computer graphics data to be rendered ("A first interpolation unit 244 
interpolates the z-gradient in the z direction, resulting in four intermediate values", 
column 12, line 64-66, therefore, the viewing direction is known by the GPU); and 

image combiners for combining the set of three-dimensional computer graphics 
data rendered by said multiple graphics processing units to produce a three- 
dimensional computer graphics image (Figure 14 has a plurality of Compositing Unit), 
wherein outputs from the multiple graphics processing units are direct inputs to first 
stage image combiners and outputs from at least two of the first stage image combiners 
are direct inputs to a second stage image combiner. 

Knittel discloses a system for presenting three-dimensional computer graphics 
images using multiple graphics processing units. It is noted that Knittel does not 
explicitly disclose "outputs from the multiple graphics processing units are direct inputs 
to first stage image combiners and outputs from at least two of the first stage image 
combiners are direct inputs to a second stage image combiner, thereby producing a 
three-dimensional computer graphics image", however, this is known in the art as taught 
by Kaufman. Kaufman discloses a system of volume visualization in which the voxel 
data is combined hierarchically (Figure 6 where voxel combination unit 38 is considered 
an image combiner and a voxel is considered a subvolume of a image). 

Thus, it would have been obvious to one of ordinary skill in the art to incorporate 
the teaching of Kaufman into Knittel because Knittel discloses a system of presenting 
three-dimensional computer graphics and Kaufman discloses the image is combined in 
several stages in order to quickly generate a three-dimensional image. 
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13. As per claim 10, Knittel and Kaufman demonstrated all the elements as disclosed 
in the rejected claim 9, and Knittel further discloses said memory comprises memory 
cells such that each of said memory cells is accessible by only one of the multiple 
graphics processing units ("The voxels are supplied to the pipelines 210-0- 212-3, 
respectively, in 4-voxel groups in a scanned order", column 15, line 9-11). 

Response to Arguments 

14. Applicant's arguments filed 12/15/2005 have been fully considered but they are 
not persuasive. 

Applicant alleges Knittel does not teach using the viewing position to determine 
an aspect of the set of three-dimensional computer graphics data to be rendered. In 
reply, Examiner considers a viewing direction is determined (see Figure 1) and the 
brightness and color of the image plane (Figure 3, item 22) is dependent on the viewing 
direction (aspect) from that plane (column 9, line 15-19). The portion the applicant 
based on for his argument (column 9, line 20-59) directly reads into the claimed 
limitations. A sample of the set of the three-dimensional computer graphics data is also 
considered a set of three-dimensional computer graphics data. 

Conclusion 

15. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
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mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 



1 6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan R. Yang whose telephone number is (571 ) 272- 
7666. The examiner can normally be reached on M-F 8:30AM-5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (571) 272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is (571) 273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-21 7-91 97 (toll-free). 
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